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Statement of Focus 



The Wisconsin Research and Development Center for Cognitive Learning 
focuses on contributing to a better understanding of cognitive learning by chil- 
dren and youth and to the improvement of related educational practices. The 
strategy for research and development is comprehensive. It includes basic re- 
search to generate new knowledge about the conditions and processes of learn- 
ing and about the processes of Instruction, and the subsequent development of 
research-based instructional materials, many of which are designed for use by 
teachers and others for use by students. These materials are tested and refined 
in school settings. Throughout these operations behavioral scientists, curricu- 
lum experts, academic scholars, and school people interact, insuring that the 
results of Center activities are based soundly on knowledge of subject matter 
and cognitive learning and that they are applied to the improvement of educa- 
tional practice. 

This Technical Report is from the Quality Verification Program and from the 
Project on the Structure of Concept Attainment Abilities in Program 1 . The Con- 
cept Attainment staff took primary initiative in identifying basic concepts in 
social studies at intermediate grade levels, while the Quality Verification Pro- 
gram assisted in developing tests to measure concept achievement and identi- 
fying reference tests for cognitive abilities. The tests will be used to study 
the relationships among cognitive abilities and learned concepts in various 
subject matter areas. The outcome of the Project will be a formulation of a 
model of structure of abilities in concept attainment in a number of subjects, 
including mathematics, science, and language arts, as well as social studies. 
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Abstract 



Test development efforts for constructing 3 5 of the tests included in a bat- 
tery of 56 tests of possible cognitive abilities are described. Data were col- 
lected on 172 boys and 210 girls who had ju&t completed the fifth grade. Item 
and total score statistics obtained for the 56 tests in the total battery are pre- 
sented and discussed. 



I 

Introduction 



The primary objective of the project en- 
titled "A Structure of Concept Attainment 
Abilities" (hereafter referred to as the CAA 
Project) is to formulate one or more models 
or structures of concept attainment abilities, 
and to assess their consistency with actual 
data. The major steps for attaining this pri- 
mary objective were taken to bes 

1. To identify basic concepts in lan- 
guage arts, mathematics, science, 
and social studies appropriate at 
the fourth grade level, 

2. To develop tests to measure achieve- 
ment of these concepts, 

3. To identify reference tests for cog- 
nitive abilities, and 

4. To study the relationships among 
learned concepts in these four sub- 
ject matter fields and the identified 
cognitive abilities . 

There are two major phases of Step 3. 
One is the examination of available systems 
for defining cognitive abilities followed by 
the selection and/or construction of tests im- 
plied by these systems. These efforts are 
described in "Three Systems of Classifying 
Cognitive Abilities as Bases for Reference 
Tosts" (Harris & Harris, in press(b)). The 
present paper contains a description of the 
procedures used for constructing some of the 
tests implied by these systems and gives 
summary item and test statistics for all of the 
tests in the battery compiled as administered 
to two different samples, one composed of 
fifth grade boys and one of fifth grade girls. 
The second major phase of Step 3 is the em- 
pirical study of the interrelations of these 
tests in an attempt to validate and/or recon- 
struct these systems, and will be reported 
elsewhere. 

Three fairly well-known systemjs for de- 
fining general cognitive abilities were ana- 



lyzed to determine the nature of possible ref- 
erence tests for cognitive abilities . They are 
the Guilford (1967) analysis of cognition 
using three contents and six products; the 
facet design for achievement, consisting of 
three tasks and three types of content, pro- 
posed by Guttman (1970); and the Primary 
Mental Abilities scheme of the Thurstones 
(1938, 1941). In analyzing these three sys- 
tems it became apparent that modifications in 
the schemata of both Guilford and Guttman 
might be appropriate for content and the opera- 
tion or task required. This led to a fourth 
schema for classifying abilities that deal with 
cognizing concepts. It involves classifying 
the nature of exemplars as things or relations; 
the content as verbal-semantic, picture- 
semantic, number-semantic, figural, number- 
symbolic, letter-symbolic, or word-form; and 
the task as classifying, excluding, or naming. 
Each of the 56 tests was classified in the 
content category; only those tests dealing with 
the cognition of concepts were classified in 
the other two categories. This schema is dis- 
cussed in more detail in Harris and Harris (in 
press (b)). 

A battery of 56 tests was developed to study 
the relationships among the Guilford, Guttman, 
and Thurstone schemata. For factor analysis, 
it is desirable to have at least two, and prefer- 
ably three, tests to measure each hypothesized 
ability (each of the identified possible cogni- 
tive abilities). Tests were selected, adapted, 
or constructed as specific measures of the 
ability implied by a cell of interest in at least 
one of the schemata, including the newly pro- 
posed system for the cognition of concepts. 
Since Guilford*s Structure of Intellect model 
is the most specific of the three schemata 
analyzed, most of the tests were initially chosen 
from his point of view. It should be pointed 
out here, however, that many of these tests 
are of the same type as those initially studied 
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Tabic I . Clcissificdtions in Koch of the SchenuiUi 



Test Name Guilford Guttman Thur stone Cognition of Concepts 



I 


Picture Meaning 


(CMU)^ 


A:P 


V 




P-M 




2 


Verbal Classification 


CMC 


RhV 


I 


T 


V-M 


C 


3 


Number Series 


CSS 


R1:N 


I 




N-M 


C 


4 


Uomembering Classes: Members 


(MMC) 


RA:V 


M 




V-M 




5 


Number Class Extension 


(CSC ) 


UI:N 


I 


T 


N - M 


( 


6 


Word Groups 


CSC 


RI 


I 


T 


w-r 


C* 


7 


Remembering Classes: Members H 


(MMC) 


RA:V 


M 




V-M 




8 


Disemvowelled Words 


CSU 


A:V 


W 




V-M 




9 


Letter Grouping 


CSC 


RI 


I 


T 


L-S 


L 


10 


Circle Reasoning 


CSS 


RI:P 


I 


R 


r 


C 


1 1 


Figure Exclusion 


crc 


K 1 : r 


T 
1 


i 


t 


1, 


12 


Seeing Trends 


CSR 


n T 

RI 


T 

i 


K 




r* 
\^ 


13 


Picture Classirication 


(OMO ) 


13 T. P 

nllr 


T 
1 


T 


P- \A 
I " ivl 




14 


Paragraph Comprehension 


O Ivl u 


A.\/ 

A: V 


V 




V IVI 




15 


Remember Classes: Names 




KA: V 


Ivl 




V" ivl 




16 


Word Group Naming 


\ fsl IvlU ) 


Ki: V 


T 
1 


T 
1 


V— IVI 


M 
iM 


17 


Gestalt Completion 


ni T 

CF U 


KAtr 






I ivl 




18 


Card Rotation:. 


Or 1 


D A • P 

KAtr 


c 




1 




19 


Spatial Relations 


CFT 


D A .D 

nA:r 


c 




p 
1 




20 


Verbal Exclusion 




nl: V 


T 
1 


T 
1 


V ivi 




21 


Best Word Class 


LIvlO 


nl: V 


T 
1 


T 


V-M 

V iVI 


M 


22 


Omelet 


CT T 

CoU 


A:V 


W 




V ivl 




23 


Picture Group Naming 


(NMO ) 


n r.r 


T 
1 


T 


P_ M 
r — ivl 


M 
iM 


24 


Concealed Words 


CFU 


DA .D 

KA:r 






V ivl 




25 


Perceptual Speed 


EFU 


RA:P 


n 
I 




I? 
r 




26 


Letter Triang^fe 


CSS 


n T 
RI 


1 


D 

K 


L"o 


\^ 


27 


Letter Classification 


(CSC ) 


D T 

nl 


T 

1 


T 


L-b 






Picture Class Memory 


Wi IvlO 


D A >P 

nA:r 


ivl 




P-M 

I iVI 




29 


Puzzles 


EMI 


A:V 


■p\ 
JJ 




V-lvl 




30 


Spelling 


CSU 


A:V 


t A/ 
W 




\I \A 

V~Ivl 




31 


Picture Exclusion- 


(CMC ) 


RI:P 


T 

I 


i 


D \A 

r-Ivl 




32 


Sensitivity to Order 


CMR 


RI:V 


I 


R 


V-M 


c 


33 


Figure Analogies 


CFR 


RI:P 


I 


R 


F 


c 


34 


Scrambled Sentences 


CMU 


A:V 


V 




V-M 




35 


Same-Opposite 


(CMU) 


RA:V 


V 




V-M 




36 


Figure Matrix 


CFR 


RI:P 


I 


R 


F 


c 


37 


Remote Class Completion 


(NMC) 


RI:V 


I 


T 


V-M 


C 


38 


Number Exclusion 


(CSC ) 


RI:N 


I 


T 


N-o 


L 


39 


Sentence Order 


NMS 


n A \i 

RA:V 


If 

V 




V-Ivi 




40 


Vocabulary 


CMU 


A:V 


If 

V 




\I \A 

V-Ivl 




41 


Word Relations 


CSR 


RI 


T 

I 


R 


W-r 




42 


Verbal Analogies 


CMR 


RI:V 


V 


n 
n 


V-Ivl 


r* 
L/ 


43 


Best Trend Name 


LMt\ 


nl: V 


1 
1 


n 
n 


V-M 

V IVI 


M 


44 


Picture Arrangement 


IMIvio 


nA. r 


V 




P-M 




45 


Arithmetic Problems 


MSI 


A:N 


N 




N-M 




46 


Identical Pictures 


EFU 


RA:P 


P 




F 




47 


Picture Group Name Selection 


(EMC) 


RI:P 


I 


T 


P-M 


N 


48 


Number Classification 


CSC 


RI:N 


I 


T 


N-S 


c 


49 


Word Exclusion 


(CSC) 


RI 


I 


T 


W-F 


E 


50 


Number Relations 


CSC 


RI:N 


I 


R 


N-M 


E 


51 


Word Linkage 


CMR 


A:V 


V 




V-M 




52 


Figure Classification 


CFC 


RI:P 


I 


T 


F 


C 


53 


Class Name Selection 


EMC 


RI:V 


I 


T 


V-M 


N 


54 


Necessary Arithmetic Operations 


CMS 


RA:N 


D 




V-M/N-M 




55 


Verbal Analogies III 


EMR 


RhV 


V 


R 


V-M 


C 


56 


Rerr:.mbering Classes: Members III 


(MMC) 


RA:V 


M 




V-M 





^Paren ".eoes indicate developer's id*?-. iuon and/or source. 



2 



Table I (Continued) 



Key to Schema Classifications; 



Guilford 



Guttman 



Contents (second letter): 



Products (third letter): 



Operations ffirst letter): C Cognition 

M Memory 

I) Divergent Production 

N Convergent Production 

i: evaluation 

M Semantic 

S Symbolic 

r Figural 

U Units 

C Classes 

R Relations 

S Systems 

T Transformations 

I Implications 

Rule-Inferring 
Rule-Applying 

Achievement or rule-applying when the rule used is formally taught 

in school 
Verbal 
Numerical 
Pictorial 



RI 
RA 
A 

V 
N 
P 



Thurstone 



S Spatial 

P Perceptual Speed 

N Numerical 

V Verbal 

W Word Fluency 

M Memory 

I Induction 

D Deduction 

Ci Closure One 



Cognition of 
Concepts 



Nature of Exemplars (first column): 



Content (second column): 



Task (third column): 





T 


Things 




R 


Relations 


V- 


M 


Verbal-Semantic 


p- 


M 


Picture-Semantic 


N- 


M 


Number-Semantic 




F 


Figural 


N 


-S 


Number-Pymbollc 


L 


-S 


Letter-Symbolic 


W 


-F 


Word-Form 




C 


Classify 




E 


Exclude 




N 


Name 



3 



by the Thurstones. Each of the tests can be 
classified, a priori, into a relevant cell of 
each'of the schemata. 

The nature of each of the 56 tests and 
their classification in each of the schemata 
is discussed in Harris and Harris (in press (b)). 
A summary of the classifications is given in 
Table I. The tests are listed in the order of 
administration. (An alphabetical listing of 
the tests with numbers corresponding to 
Table 1 is given in Appendix A.) In the case 
of the Guilford classifications, those given 
in parentheses indicate our placement of the 
test in a particular cell in the Structure of 
Intellect; the others are Guilford's identifi- 
cations. All of the other classifications are 
ours; it should be pointed out, however, that 



the basis for most of them was obtained from 
the literature, 

Of the total battery of 56 tests, 35 were 
constructed for this project. These 35 include 
Concealed Words, Gestalt Completion, and 
Verbal Analogies of which some or all of the 
items were adapted from another source. . 
These tests are described in "Newly Con- 
structed Reference Tests for Cognitive Abil- 
ities" (Harris & Harris, in press (a)). The 
source of each of the 56 tests is given in 
Appendix B, It should be pointed out here 
that Tests 4, 7, and 56 are the same test 
given on three different occasions. 

Test development procedures and results 
of data collection using the total battery will 
be discussed in the following sections. 
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II 

Procedures 



This section contains a discussion of the 
test development procedures used including 
Initial item construction and revision of the 
tests based on item analysis results for the 
35 tests that were constructed for the CAA 
Project. Data collection procedures, subjects, 
and treatment of the data for the total battery 
of 56 tests are discussed. 



Te$t Development 

Of the total battery of 56 tests, 3 5 were 
constructed by the researchers of the CAA 
Project specifically for use in the project, 19 
are published tests (used in this project for 
research purposes, with permission from the 
various publishers), and the remaining 2 tests 
are merely further administrations of one of 
the memory tests. The test development pro- 
cedures discussed in general terms here apply 
to the 3 5 tests that were constructed for this 
project. As was mentioned earlier, some items 
\vere adapted from another source. 

The first step in the test construction" 
process was the determination of the format 
and type of content for the items of each par- 
ticular test. For example, for Verbal Classifi- 
cation the content was specified as verbal- 
semantic and the task as one of adding an 
exemplar to q set of four exemplars of a class. 
All examplars» both those defining the class 
and those offered as possible additional 
exemplars, were names of things rather than 
relationships. 

When applicable, principles were enu- 
merated by which items meeting the task and 
content specifications could be generated. 
As an example: various pathways that the 
letters could follow within a triangle; various 
sections of the alphabet; whether letters were 
to be adjacent as opposed to skipping one or 
skipping two; and the direction, forwards or 



backwards within the alphabet, were specified 
for the Letter Triangle test, When the enumera- 
tion of principles by which items could be 
generated was not applicable, as with Con- 
cealed Words, the advice of experts and small- 
scale tryouts were used to assist in deter- 
mining appropriateness of specific items. 

For all of the tests dealing with classes 
using semantic content (both verbal and pic- 
torial), a sample of class names was drawn at 
random from a previously compiled long list 
of class names deemed appropriate for the 
fourth grade level. A sampled class name 
sometimes had to be dropped and replaced by 
another sampled one if the exemplars of that 
class could not be pictured or if there were 
not enough appropriate exemplars of the class . 

The items for the Verbal Analogies test 
were taken from analogy questions given oy 
Gouber (1967), He included 14 different rela- 
tions and a number of different analogies for 
each of these • In the revised form of the test, 
we used two items each for 12 different types 
of relations. In so doing, we felt that the 
antonym and synonym relations were essen- 
tially the same for our purposes and that a 
grammatical relation was inappropriate. 

Care was taken that all items for a test 
be of the same type or task. For example, for 
the Figure Classification test, items for which 
all of the exemplars and the correct choice 
formed a series were not used. An example of 
this would be each succeeding exemplar, and 
thus the correct answer, increasing in size. 
Care was taken also that all of the items be 
of the same type of content. For example, the 
Number Series test was designed to contain 
number-semantic content in a series-type for- 
mat, using numbers as cardinal numbers. Items 
that could be answered correctly simply by 
form or symbolic content of the numbers were 
not used. An example of this is: 

9 99 999 9999 
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One could say that this item involves car- 
dinciility of the numbers — ridd 90, add 900, 
edd 9G'ii>— but it can be answered correctly 
without conceptualizing this. If it were used, 
such an item would be placed in a series-type 
test using number-symbolic content. 

An attempt was made to keep reading level 
and other possible confounding aspects at a 
minimum so that the items of the test could 
elicit the student behavior for which they 
were intended. For example, the Remembering 
Classes: Names test was intended to mea- 
sure ability to remember inferred names for q 
number of classes of things. The class name 
first had to be inferred from the e.xemplars 
given, and then remembered. The exemplars, 
and hence class names, chosen for the items 
of this test were ones with which fifth graders 
were expected to be familiar. 

The previous illustrations serve as ex- 
amples of the kinds of things taken into con- 
sideration in the test construction process. 

The items that were constructed were 
subjected to extensive critique during the 
writing process, after all had been completed, 
or at both stages. The advice of experts in a 
particular subject-matter field such as mathe- 
matics was utilized when developing tests 
involving number-semantic content and/or a 
particular area of interest such as memory 
(immediate versus longer term recall). The 
advice and critique of reading specialists was 
sought regarding vocabulary used and the ap- 
propriateness of the reading level of the items. 
Some or all items of many of the tests were 
tried out on a few fifth grade and/or other 
level subjects to assist in determining ap- 
propriateness of content and/or format. All 
Items were subjected to a final critique by the 
v/riters of this paper. 



Test Revision 

Tryouts of the tests for item analysis and 
test revision purposes were conducted dur- 
ing the spring of 1969 and the winter and 
spring of 1970. The tryout version of each 
test consisted of at least 30 items; there 
were approximately 30 for most tests. Usually 
a half hour was allotted to the students to 
respond to the items for each of the tests. 
Fifteen of the tests were piloted with fourth 
grade students in the Hamilton School District 
of Sussex, Wisconsin, and the Hartford, Wis- 
consin, school district during late March and 
April of 1969. During the fall of 1970 the 
decision was made to conduct the entire CAA 
Project with fifth grade students instead of 



fourth grade students as had been originally 
planned. Thus, subsequent tryouts of cogni- 
tive abilities tests were conducted using fifth 
grade students as subjects and some minor 
rev.'sions were made in some of the 15 tests 
that had been piloted using fourth grade stu- 
dents. Further pilot studies of cognitive abil- 
ities tests were conducted during January, 
1970, with fifth grade students in the Hamilton 
School District and the West Allis, Wisconsin, 
school system. Fifth grade students in the 
Brookfield, Wisconsin, school system responded 
to a number of the tests duringApril, 1970. Ap- 
proximately 100 students responded to each 
test. Most of the tests were piloted only 
once, though several were revised extensively 
following the first tryout and then were piloted 
again 'n the revised form. 

The tryout data were subjected to the Gen- 
eralized Item Analysis Program (GITAP) (Baker, 
1969) the output of which provides the propor- 
tion responding, item-criterion biserial corre- 
lation, Xso (point on the criterion scale corre- 
sponding to the median of the item charac- 
teristic curve), and p (the reciprocal of the 
standard deviation of the item characteristic 
curve which is a measure of the discriminating 
power of the item) for each possible choice 
for each item as well as summary descriptive 
statistics for the total test. It also gives the 
Hoyt reliability for the total test and the 
standard error of measurement. Based upon 
both difficulty and discrimination indices ob- 
tained from the item analyses, usually 20 
items were selected to be retained in a re- 
vised version of the test to be used in attain- 
ing Steps 3 and 4 of the project's primary ob- 
jective as given on page 1. Items with the 
highest discrimination indices for the correct 
choice were selected with the stipulation that 
only items with X50S within the range of -2.00 
to +2.00 and, insofar as possible, well- 
representing that range be retained. If the 
p for one or more of the incorrect choices was 
an undesirable value, though otherwise the 
item was functioning well, those incorrect 
choices were revised. 

The revised version of each of the 35 
tests constructed for the CAA Project can be 
found in "Newly Constructed Reference Tests 
for Cognitive Abilities" (Harris & Harris, in 
press (a)). 



Subjects 

The battery of 56 cognitive abilities tests 
was administered during summer, 1970, to 
17Z boys and 210 girls who had Just completed 
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the fifth grade in the public school system of 
Madison, Wisconsin. The students were ran- 
domly selected from the populations of all 
such girls and boys. The Madison Public 
School System made available the informa- 
tion concerning the populations and used 
their computing facilities to designate the 
random sample for the girls. Project re- 
searchers identified the random sample for 
the boys. 

Initially, a random sample of 350 girls 
was drawn. Letters were sent to the parents 
of these students explaining the purpose and 
details of the testing, and inviting their 
daughter to participate in the testing program. 
A stamped and addressed postcard was en- 
closed which the parents were asked to com- 
plete and return indicating whether or not 
they were willing to allow their daughter to 
participate. One hundred and thirty-nine yes 
responses and 62 no responses were obtained 
from the cards returned. Those parents who 
had not returned the card by a specified date 
were phoned. An additional 49 yes and 72 no 
responses were obtained by phone. Since 
this total of yes responses did not give as 



many subjects as were desired, an additional 
sample of 100 girls was drawn at random. 
From this sample, 33 yes and 30 uo responses 
were obtained by card. Thus, of the total 
sample of 450 girls, 221 yr.> and \(A no re- 
sponses were received: 1 1 students did not 
complete the testing, resulting in a total of 
210 girls tested. These students were paid 
$15.00 for participating. 

A random sample of 4 50 boys was drawn 
and letters were sent. By mail, I36.vc.s and 
34 no responses were obtained. An additional 
36 vc5f and 80 no responses were obtained by 
phone. From an additional sample of 80 boys 
drawn at random, 21 yes and 45 no responses 
were obtained. Thus, of the total sample of 
530 boys, 193 ves and i 59 no responses were 
received; 21 students did not complete the 
testing which resulted in a total of 172 boys 
tested, ^s with the girls, the boys who com- 
pleted the testing program were paid $!5.00. 

Since the participation of all students 
comprising the random samples was impossible 
to attain, test score and IQ data were obtained 
from the files of the Madison Public School 
System, for both the school population and 



Table 2. Test Data for Population and Samples 



Test 




Population 


Boys 


Girls 


Lorge-Thorndike 


X 


106.60 


108.30 


HI .12 


Intelligence 


s 




!5.05 


13.82 




N 


2605 


157 


206 


Iowa Basic Skills 










Vocabulary 


X 


5.53 


5.69 


5.66 




s 




1.42 


1.41 




N 


2520 


171 


203 


Reading Comprehension 


X 


5.44 


5.51 


5.87 




s 




1.55 


1.42 




N 


2 520 


171 


203 


Language Skills 


X 


5.24 


5.18 


5.67 




s 




1.44 


1.32 




N 


2520 


!7I 


202 


Work-Study Skills 


X 


5.46 


5.71 


5.73 




s 




1.34 


I .13 




N 


2520 


17! 


202 


Arithmetic Skills 


X 


5.05 


5.24 


5.24 




s 




1 .09 


1.05 




N 


2520 


171 


202 


Composite 


X 


5.35 


5.46 


5.64 




s 




I .25 


I .12 




N 


2520 


171 . 


201 
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those participating students for whom the in- 
formation was available. Table 2 includes 
the summary statistics for the population of 
fifth grade students in the Madison Public 
School System during the school year of 1969- 
70» and for the boys and the girls who com- 
prised the tested samples for the cognitive 
abilities tests. The IQs were obtained in the 
fall of 1968, when the subjects were fourth 
graders, using the Lorge-Thorndlke Intelli- 
gence Test; and the scores on the Iowa Tests 
of Basic Skills, given in grade equivalent 
scores, were obtained in the fall of 1969 
when the subjects were fifth graders. 

Data on fathers' occupations were col- 
lected from the students using the Master 
Occupational Code of the United States 
Bureau of the Census. These data were tabu- 
lated and are presented in Table 3, 



Data Collection 

The data for the girls were collected in 
two centrally-located schools, one on the 
East side and one on the West side of the 
city, during nine 2 j -hour daily sessions over 
a two-week period. Subjects could choose 
the weeks and the school in which they 
wanted to report for testing . A two-week 
session was held at Hawthorne School from 
June 29 to July 10 and a two- week session 
was held at Hoyt School from July 20 to 
July 31. Each 2'i'-hour session consisted of 
the students responding to two booklets com- 
posed, in most cases, of three tests each, 
and a-^-hour activity break after completing 
the first booklet. 

The data for the boys were collected at 
the University of Wisconsin, during five 3f- 
hour daily sessions for one week. Two differ- 
ent weekly sessions, August 17 to August 21 
and August 24 to August 28, were held and 
the subjects could choose the week which 
they preferred. 

The 56 tests in the battery were arranged 
in 18 booklets composed of three tests each, 
with the exception of two booklets that con- 
tained four tests each. The tests were given 
in the same order to all of the subjects in 
each of the samples. The students responded 
to the tests by marking their chosen response 
for each item directly on a machine-scorable 
answer sheet for 45 of the tests. For the re- 
maining 11 tests, the students responded 



directly in the test booklet. The subjects' 
responses to these 11 tests were later coded 
onto machine-scorable answer sheets. All of 
the answer sheets were read by machine and 
the responses punched onto data cards. The 
tests were riven by experienced test adminis- 
trators to groups of approximately 30 subjects 
each . 

The tests were not administered in a 
speeded fashion except for two tests, Per- 
ceptual Speed and Identical Pictures, which 
were designed to be speeded tests, A sug- 
gested time limit was given for each test. If 
five or more students were still working at 
the end of the time limit » the time for the test 
was extended until fewer than five students 
were still working. If all subjects finished 
the test before the suggested time limit was 
up, the test administrator went on to the next 
test. The suggested time limit was ample for 
every subject to complete most of the tests. 

Treatment of the Data 

The treatment of the data consisted of two 
main procedures: reliability estimation and 
item analysis. The data were analyzed sep- 
arately for each sex group. Hoyt analysis of 
variance reliability estimates were obtained 
for each of the tests as well as means and 
standard deviations. 

Item analyses using the GITAP program 
(Baker, 1969) were obtained for each of the 
items as a part of its total test score. This 
program provides proportion responding, item- 
criterion biserial correlation, X50, and (3 sta- 
tistics for each choice of each item. The 
proportion of students who respond correctly 
to an item is an index of the difficulty level 
of that item. The greater the value of the* 
difficulty index, the easier the item. The bi- 
serial correlation coefficient is an index of 
the discriminating ability of the item choice. 
For these analyses the criterion ability used 
was the appropriate total test score. X50 is 
the point on the criterion scale, given in 
standard deviation units, corresponding to 
the median of the item characteristic curve. 
It is the score point at which subjects have a 
50-50 chance of choosing that response, p is 
the reciprocal of the standard deviation of the 
item characteristic curve at the X50 point. It 
is an index of the discrimination power of the 
item. 
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Table 3. Distribution of Fathers' Occupations 



Occupation 



Boys 



PROFESSIONAL, TECHNICAL, AND KINDRED WORKERS 

00. Accountant 

01. Architect 

02. Dentist 

03. Engineer 

04. Lawyer, Judge 

05. Clergyman 

06. Doctor 

07. Nurse 

08. Teacher, Professor 

09. Other Professional 



FARMER 
11. 



Farmer 



MANAGERS. OFFICIALS, PROPRIETORS, EXCEPT FARM 

21 . Owner of Business 

22. Manager, Official 

CLERICAL AND KINDRED WORKERS 

31. Bookkeeper 

32. Receptionist 

39. Other Clerical and Kindred Workers 

SALES WORKERS 
49. Salesman 

CRAFTSMEN, FOREMEN, AND KINDRED WORKERS (SKILLED WORKERS) 

51. Craftsmen, Skilled Worker 

52. Foreman 

53. Armed Services — Officer 

54. Armed Services — Enlisted Man 

OPERATIVES AND KINDRED WORKERS (SEMI-SKILLED WORKERS) 

61, Truck Driver 

62. Operative in Factory 

69. Other Operative and kindred Workers 

PRIVATE HOUSEHOLD AND SERVICE WORKERS 

71. Fireman 

72. Policeman 

73. Other Protective Service Worker 

74. " Practical Nurse, Nurses Aide 

75. Private Household Workers 
79 . Other Service Workers 

81 . Non-Farm Laborer 

82. Farm Laborer 

91 • Not presently in labor force 
99 . Not ascertained 



6 
2 

3 
4 
3 
9 

15 
12 



3 
19 

1 

2 

20 

20 
4 
2 
2 

5 
9 
13 



2 
1 

17 
1 

2 
6 



Girls 



4 
1 
1 

10 
1 
2 
3 

9 
21 



5 
20 

1 
8 

19 

10 
1 
1 



5 
9 

32 

4 
1 

2 

23 



6 

12 



er|c 
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Ill 

Results and Discussion 



The means » standard deviations, and 
Hoyt reliability estimates obtained for the 
summer, 1970, test battery data are presented 
separately for boys and girls, for each test. 
Also included in this section are a presenta- 
tion and discussion of a summary of the item 
indices obtained for the correct choice for 
each of the tests. 



Reliability Estimates and 
Test Statistics 

Table 4 contains the means, standard 
deviations, and Hoyt reliability estimates 
obtained for the data collected during sum- 
mer, 1970, using the 56 tests in the battery. 
These 56 tests consist of 35 which were con- 
structed specifically for the CAA Project, 19 
published tests, and two which are merely 
two further administrations of one of the 
memory tests. The source of each test is 
given in Appendix B. The data were analyzed 
separately for the 172 boys and the 210 girls. 
Table 4 includes the results for both of the 
samples. The number of items composing 
each of the tests is given in Table 4. If one 
is interested, the number of choices for each 
item of each test can be found in Appendix B. 
The tests are included in Table 4 in the order 
of administration. An alphabetical listing of 
the tests is given in Appendix A. 

The mean scores and standard deviations 
are very similar for boys and for girls. The 
reliability estimates are generally slightly 
higher for boys than they are for girls. The 
reliability estimates are, in general, quite 
good with only 13 of the 112 estimates be- 
low .70; 56 of the estimates are equal to or 
greater than .80 with 13 of these being equal 
to or greater than .90. Of the 13 reliability 
estimates below .70, seven of them are for 
tests using pictures as semantic content. Per- 
haps it is more difficult to build reliable tests 



using pictures for the stimulus material. The 
reliability estimates for one test, Verbal Anal- 
ogies III, were quite low for both boys and 
girls. Evidently this test was too difficult for 
these subjects. 

These are relatively short tests, but only 
numbers 25 (Perceptual Speed) and 46 (Identi- 
cal Pictures) were administered in a speeded 
fashion. For these two speeded tests, the Hoyt 
reliability estimate probably is an overestimate. 
It is interesting to note that the reliability es- 
timates for the memory test that was given on 
three different occasions — at the beginning of 
an hourly test session; at the end of this same 
hour session without restudy of the material; 
and as the last test in the battery, again with- 
out restudy of the material — remained almost 
identically the same over the three occasions. 
The means are much the same for the first two 
occasions but dropped somewhat for the third 
occasion. These three test administrations 
are numbered 4, 7, and 56. 

The reliability estimates are sufficiently 
high to warrant study of the dimensionality of 
these selected cognitive abilities tests (with 
the exception of the Verbal Analogies III test), 
which is a major objective of the CAA Project 
and is the main purpose for developing this 
battery of 56 tests. The factor analyses of 
these data will be reported in a later paper. 

Item Indices 

Table 5 contains a summary by sex of 
the item' indices obtained for each of the 56 
tests. The indices included are proportion 
correct (this often is called difficulty or P), 
item-criterion biserial correlation, X501 and p. 
They are given for the correct choice only. 
For proportion correct and biserial correlation, 
the highest, lowest, and mid-value obtained 
over all of the items for a test is given; for 
X50 and p only the mid- value over all of the 
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Table 4. Means, Standard Deviations, and Reliability Estimates; Boys and Girls 



Test 



Number 






Standard 


Hoyt 


OI 


Mean 


Deviation 


Reliability 


Items 


Boys 


Girls^ 


Boys 


Girls 


Boys 


Girls 




^ 1 o e 
2 1 .o5 


20.74 


4.28 


4.66 


.78 


.80 


"y f\ 
cO 


1 b ti J 


16.53 


3.34 


3.02 


.77 


.74 


zo 


1 3 .62 


13.25 


4.43 


4.17 


.85 


.82 


£,{) 


1 >( yl A 


1 5.08 


3.60 


3.58 


.75 


.77 


cO 


1 A >l A 

1 0 .40 


9.72 


4.74 


3.98 


.83 


.74 


ZQ 


1 >( o e 
14 .o5 


15.31 


4.09 


3.73 


.82 


.80 


20 


14 .26 


15.11 


3.90 


3.51 


.78 


.75 


32 


2 1 .66 


23.45 


7.82 


6.42 


.93 


.89 


20 


1 1 .52 


12.50 


3.95 


3.48 


.77 


.72 


20 


8.43 


9.90 


4.94 


4.61 


.86 


.83 


25 


20.06 


20.00 


2.89 


2.70 


.64 


.59 


20 


1 1 .9 1 


12.52 


4.30 


4.32 


.80 


.81 


20 


1 2.74 


12.53 


3.28 


2.84 


.69 


.59 


32 


1 Q ^1 


19.45 


6.27 


5.60 


.84 


.80 


20 


1 L QZ 
1 0 .96 


18.36 


3.28 


2.39 


.81 


.79 




1 ^ .^3 


TO OA 

12.30 


3 .73 


3 .40 


.75 


.68 


20 


15 Q 1 


1 o o c 
l^.OD 


3 .43 


3 .67 


.72 


.76 




Q O AO 


o z o o 

86.38 


22.34 


20.84 


.98 


.97 




1 D . r U 


1 7 C 

1 b . r 3 


4.58 


4.3 1 


.81 


.78 




1 J .4^ 


1 1 OA 

10 .oU 


3 .23 


2.61 


.70 


.56 


^ u 


1 5 7 K 


15 1 

l^.bl 


4.11 


3.78 


.79 


.75 




1 n Q7 


l^.^l 


4.44 


4.21 


.84 


.82 




1 5 7A 
1 ^ . r 4 


1 O AO 


3.54 


3 .37 


.72 


.67 




Q 77 
7 . f f 


8.67 


3 .88 


3.45 


.78 


.72 


A n 




5 7 A/L 

^ J .Ub 


Z 11 

6.32 


5.44 


.89 


.86 




1 A 7Q 
i4.ro 


1 c ^ c 
1 3.43 


3 .68 


3 .64 


.79 


.81 




1 5 75 


1 7 Q7 

1 0 .o r 


A OA 

4 .00 


3 .77 


.81 


.78 






1 3 .bU 


O AO 

2.98 


3 .29 


.69 


.76 


J u 


5 5 no 

^ ^ .U7 


OO A 1 

^0 .41 


4.39 


4.24 


.74 


.76 


J u 


17 1 A 
1 r . 14 


l7.4b 


7.00 


6.32 


.89 


.87 




1 5 7A 
1 ^ • r 4 


1^.4b 


2.92 


2.92 


.56 


.57 


C,\J 


1 J .b J 


13 .94 


A t Z 

4.26 


3.98 


.84 


.81 


cc 


1 C QQ 
1 3 .07 


lb.b4 


C Ac 

5.95 


4.87 


.92 


.88 




17 >* 7 

1 0 .4 r 


y 1 AC 
10 .4 b 


2.88 


2.87 


.53 


.52 




1 ^ 5 

1 b r 


1 Z. CA 

16.50 


3.86 


3.51 


.84 


.81 


20 


1 A AC 

1 0 .9 5 


9.36 


4.63 


4.11 


.82 


.76 


2b 


12 .73 


13.08 


4.32 


4.42 


.77 


.80 


20 


11.97 


12.15 


4.30 


3.53 


.81 


.71 


40 


32.42 


34.31 


8.01 


7.01 


.93 


.93 


30 


19.24 


19.20 


6.70 


6.00 


.89 


.86 


20 


It z z 

12 .66 


13.07 


5.44 


5.64 


.90 


.91 


24 


14.92 


14.82 


4.49 


4.69 


.78 


.81 


20 


1 0.65 


10.50 


4.12 


3.71 


.77 


.70 


16 


Q O Z 

9 .86 


9.61 


2.37 


2.71 


.50 


.63 


3 5 


16 .58 


16.59 


7.19 


7.40 


.90 


.91 


48 


22.09 




5.39 


6.17 


.88 


.91 


20 


14.41 


14.00 


3.01 


3.21 


.66 


.70 


30 


22.75 


22.44 


7.24 


7.31 


.93 


.93 


20 


11.67 


11.33 


3.70 


3.45 


.73 


.68 


20 


11.94 


10.37 


5.16 " 


4.52 


.87 


.81 


20 


11.48 


11.90 


4.28 


4.34 


.78 


.79 


20 


14.42 


14.43 


3.84 


4.13 


.82 


.82 


20 


15.36 


14.94 


3.59 


3.74 


.80 


.81 


15 


10.53 


10.48 


3.78 


3.74 


.85 


.84 


20 


6.44 


6.15 


2.43 


2.44 


.39 


.43 


20 


13.05 


13.72 


3.88 


3.71 


.7.7 


.75 



1 

2 
3 
4 
5 
6 
7 
8 
9 

10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 
46 
47 
48 
49 
50 
51 
52 
53 
54 
55 
56 
a 



Picture Meaning 
Verbal Classification 
Number Series 

Remembering Classes: Members 
Number Class Extension 
Word Groups 

Remembering Classes: Members II 

Disemvowelled Words 

Letter Grouping 

Circle Reasoning 

Figure Exclusion 

Seeing Trends 

Picture Classification 

Paragraph Comprehension 

Remembering Classes: Names 

Word Group Naming 

Gestalt Completion 

Card Rotations 

Spatial Relations 

Verbal Exclusion 

Best Word Class 

Omelet 

Picture Group Naming 
Concealed Words 
Perceptual Speed 
Letter Triangle 
Letter Classification 
Picture Class Memory 
Puzzles 
Spelling 

Picture Exclusion 

Sensitivity to Order 

Figure Analogies 

Scrambled Sentences 

Same-Opposite 

Figure Matrix 

Remote Class Completion 

Number Exclusion 

Sentence Order 

Vocabulary 

Word Relations 

Verbal Analogies 

Best Trend Name 

Picture Arrangement 

Arithmetic Problems 

Identical Pictures 

Picture Group Name Selection 

Number Classification 

Word Exclusion 

Number Relations 

Word Linkage 

Figure Classification 

Class Name Selection 

Necessary Arithmetic Operations 

Verbal Analogies III 

Remembering Classes; Members III 



Number of subjects is 172 for boys and 210 for girls. 
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items of a test is given. For some of the tests, 
the highest value of X50 and (3 for an item in 
the test could not be computed; this is the 
case when the blserial correlation is 1.00 or 
greater. When the blserial correlation is near 
zero, which is the case for the lowest value 
for a few of the tests, the X50 becomes very 
large and meaningless. As with Table 4, the 
tests are listed in the order of administration. 
An alphabetical listing of the tests with their 
numbers on this table is given in Appendix A. 
The number of choices for each item of each 
test can be found In Appendix B. 

It should be emphasized here that these 
item statistics are not really c >nropriate for 
the two speeded tests. Perceptual Speed (25) 
and Identical Pictures (46). The low biserlal 
correlations were for items that appeared early 
in the test which were answered Incorrectly 
by only one or two subjects. 

As was evident from the means of the 
total scores, and as can be seen from the tv;o 
difficulty indices given for the Items (propor- 
tion correct and X50). the Items generally were 
at the same difficulty level for boys as for 
girls. The obtained difficulty indices and 
mean scores Indicate that these tests are ap- 
propriately difficult for these subjects with 
the exception of Verbal Analogies III which 
seems to be too difficult. In general, many 
of the tests tend to be fairly easy for fifth 
grade subjects . 

The proportion correct indicates how 
many subjects responded correctly to an item. 
The item difficulty index X50 gives, in standard 
deviation units, the criterion score at which 
a subject would have a 50-50 chance of getting 
the item correct. For example, an X50 value of 
1.20 for an item means that subjects with a 
criterion score 1.20 standard deviation units 
above the mean have a 50% chance of answer- 
ing that item correctly. Subjects with a cri- 
terion score higher than this have a greater 
chance of answering that item correctly and 
subjects with a criterion score lower than this, 
a lesser chance. Similarly, an X50 value of 
-1.20 means that subjects with a criterion 
score 1.20 standard deviation below the mean 
have a 50% chance of getting that item cor- 
rect; for a higher score the chance would be 
greater and for a lower score the chan a would 
be less. 

The two item discrimination indices, bi- 
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serial correlation and P, are closely related 
since (3 is computed as a function of the bi- 
serial correlation (Baker, 1969). They are not 
linearly related, however. From .00 to about 
.30 (absolute) they are very nearly the same; 
beyond this, (3 begins to increase quite rapidly 
in magnitude. It may be pointed out that (3 is 
always equal to or greater (absolute) than the 
biserial correlation. As a general rule, .30 is 
often used as a lower cutting point for a de- 
sirable blserial correlation or (3. For a test 
composed of highly homogeneous items, which 
is desirable for these cognitive abilities tests, 
the higher the discrimination indices the bet- 
ter. 

As can be seen from Table 5, the mid- 
values for the biserial correlations and (3s are 
generally quite high. The highest biserial 
correlation is very good for most of the tests. 
Some of the lowest biserial correlations are 
lower than is desirable — less than .30. The 
highest and the lowest value of the biserial 
correlation may not be for the same item for 
both boys and girls. A summary of all of the 
poor items, with a poor item defined as one 
having a (3 less than .30 for the correct choice, 
reveals that for all of the tests except the two 
speeded ones there is a total of 22 poor items 
for boys only, 36 for girls only, and 17 that 
were poor for both boys and girls. Thus, of 
the total of 1294 items, 39 of them functioned 
poorly for the boys and 53 of them functioned 
poorly for the girls. It may be pointed out 
here that some of these were items included 
in published tests. 

There does not seem to be a consistent 
pattern in the magnitude of the mid-values of 
the (3s for the boys as compared with the girls. 
For some of the tests, the (3s are higher for 
the boys and for some of them they are higher 
for the girls. For the tryouts of the constructed 
tests, data for both boys and girls were ana- 
lyzed together. If the data for boys and girls 
were pooled and item analyzed, the (3 values 
would probably increase for most of the items. 
This is also indicated by the number of items 
that were defined as poor ones for one of the 
samples and not for the other. 

Almost all of the items have desirable bi- 
serial correlations and (3s; this is true for 
approximately 95% of the items for the girls 
and approximately 97% of the items for the 
boys . 
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IV 

Summary and Conclusions 



The primary objective of the project en- 
titled "A Structure of Concept Attainment Abil- 
ities" is to formulate one or more models or 
structures of concept attainment abilities, 
and to assess their consistency with actual 
data. One of the major steps for attaining 
this primary objective was taken to be the 
identification of reference tests for cognitive 
abilities. This paper describes the test de- 
velopment efforts for constructing 35 of the 
tests included in a battery of 56 tests of pos- 
sible cognitive abilities . This paper also 
presents the item and total score statistics 
obtained for the 56 tests in the total battery. 

Fifty-six tests were suggested by an 
analysis of three fairly well-known systems 
for defining general cognitive abilities and 
by a fourth schema which was suggested by 
this analysis. These 56 tests were admin- 
istered during summer, 1970, to 172 boys and 
210 girls who had Just completed the fifth 
grade. The data were item analyzed separately 
for boys and for girls, using the GITAP pro- 
gram (Baker, 1969). 

The means, standard deviations, and Hoyt 
reliability estimates obtained for each of the 



tests are presented and discussed. A summary 
of four different item indices — proportion cor- 
rect, item-criterion biserial correlation, Xjoi 
and p — obtained for the correct choice for 
each item of each test is presented and dis- 
cussed. 



Conclusions 

The major conclusions drawn are: 

1 . With the exception of the Verbal 
Analogies III test, the reliability 
estimates obtained for these selected 
tests of possible cognitive abilities 
are sufficiently high to warrant study 
of the dimensionality of these tests. 

2. The means of the tests and the diffi- 
culty item indices obtained indicate 
that these tests are of appropriate 
difficulty levels for these subjects 
except for the Verbal Analogies III 
test which is too difficult. 

3. Almost all of the items have desirable 
levels of discrimination indices. 
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Appendix A 
Alphabetical Listing of Tests 



Arithmetic Problems (45) 

Best Trend Name (43) 

Best Word Class (21) 

Card Rotations (18) 

Circle Reasoning (10) 

Class Name Selection (53) 

Concealed Words (24) 

Disemvowelled Words (8) 

Figure Analogies (33) 

Figure Classification (52) 

Figure Exclusion (11) 

Figure Matrix (36) 

Gestalt Completion (17) 

Identical Pictures (46) 

Letter Classification (27) 

Letter Grouping (9) 

Letter Triangle (26) 

Necessary Arithmetic Operations (54) 

Number Class Extension (5) 

Number Classification (48) 

Number Exclusion (38) 

Number Relations (50) 

Number Series (3) 

Omelet (22) 

Paragraph Comprehension (14) 
Perceptual Speed (25) 
Picture Arrangement (44) 
Picture Class Memory (28) 



Picture Classification (13) 

Picture Exclusion (31) 

Picture Group Name Selection (47) 

Picture Group Naming (23) 

Picture Meaning (1) 

Puzzles (29) 

Remembering Classes: Members (4) 

Remembering Classes: Members II (7) 

Remembering Classes: Members III (56) 

Remembering Classes: Names (15) 

Remote Class Completion (37) 

Same-Opposite (35) 

Scrambled Sentences (34) 

Seeing Trends (12) 

Sensitivity to Order (32) 

Sentence Order (39) 

Spatial Relations (19) 

Spelling (30) 

Verbal Analogies (42) 

Verbal Analogies III (55) 

Verbal Classification (2) 

Verbal Exclusion (20) 

Vocabulary (40) 

Word Exclusion (49) 

Word Group Naming (16) 

Word Groups (6) 

Word Linkage (51) 

Word Relations (41) 
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c , Apendix B 

Source of Test and Number of Choices for Each Item 




Picture Meaning 
Verbal Classification 
Number Series 

Remembering Classes: Members 
Number Class Extension 
Word Groups 

Remembering Classes: Members II 

8 LJlsemvowelled Words 

9 Letter Grouping 
Circle Reasoning 
Figure Exclusion 
Seeing Trends 
Picture Classification 
Paragraph Comprehension 

15 Remembering Classes: Names 

16 Word Group Naming 

17 Gestalt Completion 

18 Card Rotations 



10 
11 
12 
13 
14 



19 
20 
21 
22 
23 
24 

25 
26 
27 
28 
29 



Spatial Relations 
Verbal Exclusion 
Best Word Class 
Omelet 

Picture Group Naming 
Concealed V\^ords 

Perceptual Speed 
Letter Triangle 
Letter Classification 
Picture Class Memory 
Puzzles 



30 Spelling 

31 Picture Exclusion 

32 Sensitivity to Order 

33 Figure Analogies 

34 Scrambled Sentences 



Primary Mental Abilities Tests (1962) 
Constructed^ ^wo^j 
Constructed 
Constructed 
Constructed 
Constructed 
Constructed 
Constructed 
Constructed 
Constructed 

Primary Mental Abilities Tests (1962i 

Constructed 

Constructed 

Iowa Tests of Basic Skills (1964) 

Constructed 

Constructed 

Adapted from Gestalt Completion Test— 

C-1 (ETS Kit, 1962) 
Card Rotations Test~S-l. Part IT 

(ETS Kit, 1962) 
Primary Mental Abilities Tests (1962) 
Constructed 
Constructed 
Constructed 
Constructed 

Adapted from Concealed Words Test 

Cs-2 (ETS Kit, 1962) 
Primary Mental Abilities Tests (1962) 
Constructed u^o^j 

Constructed 
Constructed 

Selected Items from Test of Logical 
Ability (Hill, I960) 

Iowa Tests of Basic Skills (1964) 

Constructed 

Constructed 

Lorge-Thorndlke Intelligence Tests. (1964) 
Constructed ' 



4 

3 

5 

2 

3 

3 

2 

5 
4 
7 
4 
3 
3 
4 
2 

Free response^ 
Free response^ 

2 
4 
4 
4 

Free response^ 
Free response^ 

Free response^ 
6 
3 
3 
2 

2 
5 
4 
5 
5 
2 
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Appendix B (Continued) 



Test 



Source 



Number of 
Choices 



35 Same-Opposite 

36 Figure Matrix 

37 Remote Class Completion 

38 Number Exclusion 

39 Sentence Order 

40 Vocabulary 

41 Word Relations 

42 Verbal Analogies 

43 Best Trend Name 

44 Picture Arrangement 



45 Arithmetic Problems 

46 Identical Pictures 

47 Picture Group Name Selection 

48 Number Classification 

49 Word Exclusion 

50 Number Relations 

51 Word Linkage 

52 Figure Classification 

53 Class Name Selection 

54 Necessary Arithmetic Operations 

55 Verbal Analogies III 

56 Remembering Classes: Members III 



Free response*^ 
4 
3 
4 
5 



Constructed 

Sheridan Psychological Services, Inc. 
(1969) 

Adapted from WADDLE Test (Warren 

& Davis, 1970) 
Constructed 
Constructed 

Iowa Tests of Basic Skills (1964) 
Constructed 

Items adapted tvom Analo/:;y Qucstiofis 

(Gouber, 1967) 4 

Sheridan Psychological Services, Inc. 

(1969) 3 

Dorothy C. Adklns* adaptation of the 
comic strip "Louie." 

Free response^ 

Adaptedbyand obtained from J. P.Guilford Free response^ 
Identical Pictures Test — P-3, 

Part II (ETS Kit. 1962) 
Constructed 
Constructed 
Constructed 
Constructed 
Constructed 

Lorge-Thorndlke Intelligence Tests 

(1964) 
Constructed 
NLSMA Reports (1968) 
Sheridan Psychological Services, Inc. 

(1969) 4 
Constructed 2 



5 
3 
5 
4 
4 
3 

5 
3 
4 



^The tests for which the source Is "Constructed" can be found In "Newly Constructed Reference 

?eSu cSitTn ^T^' '""r't ' ConcTatd w^^^^^^^^^ 

Gestalt Completion tests can also be found there as can the Verbal Analogies test. 



Each Item of this test was scored right or wrong 
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